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1 Executive Summary 

The overall objective of the Attentive Sensing project was to examine a class of problems involving the 
effective allocation of sensing resources in situations involving tunable sensors, configurable sensor suites, or 
constraints in communication bandwidth and processing resources. In this executive summary, we briefly 
summarize the technical accomplishments in this project from January 1, 2000 to November 30. We also 
describe the personnel supported by this project, the publications resulting from the project, and technical 
interactions arising from this project. 

1.1 Technical Accomplishments 

The technical work done in this project was organized into two broad areas. The first was attentive detection 
and localization of a target using a configurable sensor; this area dealt primarily with problems in which 
the unknowns and sensor configuration variables were discrete. The second area was attentive estimation 
of the state of a dynamic system; this area involved unknowns and sensor configuration variables that were 
continuous. We briefly describe the progress in each of these two areas. 

1.1.1 Detection and Localization of Targets 

Our objective in this area was to formulate and evaluate optimal and good suboptimal sensor configuration 
strategies for target detection and localization using a configurable sensor. We used the following problem 
formulation to investigate sensor configuration strategies: prior information about the target presence and 
location is represented by a probability distribution; the sensor performance in a given configuration is 
characterized in terms of probabilities of detection and false alarm; and a loss function is used to represent 
the utility of potential decisions. In a typical problem, a target, located in one of M cells, is detected and/or 
localized by repeated use of a sensor to interrogate cells. The sensor makes both missed detection and false 
alarm errors. Both single mode and dual mode sensors were investigated. Sensor configuration rules were 
derived with respect to two optimality criteria: 

1. Minimize the probability of error when the sensor is applied a fixed number of times ( i.e . over a fixed 
time horizon). 

2. Minimize the number of sensor uses needed to achieve a given probability of error. 

We implemented Matlab and C++ programs to compute the performance of optimal and sub-optimal sensor 
scheduling rules for both optimality criteria. 

For Criterion 1, we investigated the multi-use optimal configuration rule as well as several heuristic sensor 
scheduling algorithms; the heuristics were all myopic {i.e. they determine only the next sensor configuration, 
not the sequence of sensor configurations). The computational cost of the myopic rule increases linearly with 
the length of the time horizon, while the cost of the multi-step rule increases exponentially with the length 
of the time horizon. Thus, for computational reasons, the multi-use optimal rule was investigated only for 
small number of cells and for short time horizons. The evaluated heuristics include: 

1. Interrogate the most probable cell. 

2. Interrogate the second most probable cell. 

3. Interrogate the myopic optimal cell {i.e. the cell which leads to the lowest probability of error after a 
single interrogation). 



We found that for this problem, the heuristic of choosing the myopic optimal cell performs better than the 
other two heuristics, and that this heuristic gives near optimal performance (compared to the multi-step 
optimal rule) for both single and dual mode sensors. 

For Criterion 2, we developed a method of computing an approximately optimal sensor configuration rule 
to minimize the number of sensor uses needed to achieve a given probability of error; this method is based on 
the discretization of the target probability simplex to a finite grid, and is limited for computational reasons 
to small numbers of cells. We also investigated the three heuristics described above and a two stage heuristic 
that first detects and then localizes the target. We compared the performance of the most probable heuristic 
with that of the optimal rule to minimize the number of sensor uses, and found that the performance of the 
most probable heuristic was good but clearly suboptimal. We also found that the most probable heuristic 
gave the best performance of the four heuristics evaluated. 

1.1.2 Attentive Estimation of the State of a Stochastic System 

Our objective in this areas was to find and evaluate optimal and good suboptimal configuration strategies for 
the problem of estimating the state of a stochastic system from measurements obtained from a configurable 
sensor. We used the problem of target tracking with a non-linear “foveal sensor” for this investigation. 

A foveal sensor is a non-linear sensor of target position that has a central high-acuity (foveal) region 
surrounded by a lower-acuity region; this sensor is motivated by the density of photo-receptors in a biological 
visual system. The sensor is steerable, so the foveal region can be located where desired. We investigated 
both sensors in which the acuity of the foveal region was fixed and sensors in which the acuity of the foveal 
region could be adjusted. A narrow foveal region gives very accurate measurements of target position within 
a narrow range of positions, while a wide foveal region gives less accurate measurements within a wider 
range. 

We have investigated the performance of a target tracking algorithm based on the foveal sensor. The 
non-linearity of the foveal sensor (and in particular the sensor gains that vary as a function of position) make 
application of a Kalman filter-based tracker very difficult. Prior to the Attentive Sensing project, significant 
effort had been devoted to developing data preprocessing strategies to match a Kalman filter to the foveal 
sensor. In the bulk of our work, we have used a Bayesian filter implemented by a particle filter ( i.e. by 
sequential importance sampling). In a Bayesian filter, the estimator directly computes the posterior density 
of the system state given the observation sequence. The particle filter approximates the posterior density by 
weighted samples. 

We have investigated the performance of a heuristic approach to foveal sensor configuration. In this 
heuristic, we center the foveal region on the predicted target position, and adjust the width of the foveal 
region to match the variance of the predicted position estimate. 

The performance of a tracker that estimates a target’s one-dimensional position and velocity using a 
foveal sensor was evaluated; we investigated both a fixed acuity sensor and an adaptive acuity sensor. As 
expected, the adaptive acuity sensor performed better than the fixed acuity sensors. 

We have also investigated tracking a target moving in three dimensions using multiple foveal sensors. 
We have investigated tracker performance for both a centralized sensor configuration architecture and for a 
distributed sensor configuration architecture. 

1.2 Personnel Supported 

Personnel supported by this project include: 

1. Darryl Morrell, PI 

2. Doug Cochran, Co-PI 
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3. Dana Sinno, Graduate Research Assistant 

4. Ya Xue, Graduate Research Assistant 

1.3 Publications 

The following conference papers were written as a consequence of this work: 

1. D. Sinno, D. Cochran, and D. Morrell, “Multi-mode Detection with Markov Target Motion,” Proceed¬ 
ings of the Third International Conference on Information Fusion, Volume 2, July 2000, pp. 25-31. 

2. D. R. Morrell and Y. Xue, “Analysis of and Heuristics for Sensor Configuration in a Simple Target 
Localization Problem,” Conference Record of the 35th Asilomar Conference on Signals, Systems, and 
Computers, November 2001, pp. 1391-1395. 

3. D. R. Morrell and Y. Xue, “Bayesian Analysis of Target Localization using a Dual-Mode Sensor,” 
Proceedings of the 2002 International Conference on Acoustics, Speech, and Signal Processing, May 
2002, pp. 1593-1596. 

4. Y. Xue and D. Morrell, “Adaptive Foveal Sensor for Target Tracking,” Conference Record of the 36th 
Asilomar Conference on Signals, Systems, and Computers, November 2002, pp. 848-852. 

5. Y. Xue and D. Morrell, “Target "Racking and Data Fusion using Multiple Adaptive Foveal Sensors,” 
to be presented at the 6th International Conference on Information Fusion, July 2003. 

The following theses and dissertations were supported in whole or in part by this grant: 

1. Dana Sino, Attentive management of configurable sensor systems, PhD Dissertation, 2000. 

2. Ya Xue, Configuration of Systems of Attentive Sensors, MS Thesis, December 2002. 

1.4 Technical Interactions 

The following research interactions were related to this project: 

1. D. Morrell presented a talk in the ASU Math Department’s Cognition Seminar on this work in March 
of 2001. 

2. D. Morrell and Y. Xue presented a poster at the Asilomar conference on this work in November of 

2001. 

3. D. Morrell presented a talk in the ASU Math Department’s Cognition Seminar on particle filters and 
the foveal sensor on April 9, 2002. 

4. D. Morrell presented a talk at Brigham Young University on particle filters and the foveal sensor on 
May 29, 2002. 

5. D. Morrell and Y. Xue presented a poster at ICASSP02 on this work. 

6. D. Morrell presented a talk in the ASU Stochastic Modeling Seminar on particle filters and the foveal 
sensor on October 10, 2002. 

7. Results from this work formed the starting point for the DARPA ISP contract that was awarded in July 
of 2002. The PI has begun work with Raytheon Missile Systems Division, who is the prime contractor 
on the DARPA ISP effort, to develop useful models for sensor scheduling. The PI has also provided 
some help to Raytheon in the area of target tracking using particle filters. 
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2 Introduction 

The technical work done in this project was organized into two broad areas. The first was attentive detection 
and localization of a target using a configurable sensor; this area dealt primarily with problems in which 
the unknowns and sensor configuration variables were discrete. The second area was attentive estimation 
of the state of a dynamic system; this area involved unknowns and sensor configuration variables that were 
continuous. We briefly describe the progress in each of these two areas. 

Our work on target detection and localization has included the development of several Matlab and C++ 
programs to evaluate the performance of sensor configuration algorithms. We have implemented simulators 
to evaluate the performance of the sensor configuration strategies. We have also implemented programs 
to directly compute system performance for the detection and localization problems; the programs provide 
exact values of the probability of error for a fixed number of sensor uses, and provide close lower bounds for 
the expected number of sensor uses needed to achieve a given probability of error. The work on detection 
and localization has been documented in two conference papers [1,2]. 

Our work on attentive estimation also included the development of Matlab simulators; these simulators 
were used to ascertain the performance of state estimators using foveal sensor measurements for targets 
moving in one and three dimensions. This work has been documented in two conference papers [3,4]. 

3 Attentive Detection and Localization 

As previously described, attentive detection, localization, and classification problems typically involve discrete¬ 
valued unknowns and sensor settings. In a generic problem, the following three steps are repeated either a 
fixed number of times or until a given performance measure ( e.g . maximum allowed probability of error) is 
achieved: 

1. Configure one or more sensors (perhaps after selection from a suite of possible sensors). 

2. Collect one or more observations using the sensors. 

3. Use the observations to update the posterior probability distribution of the desired information. 

This generic problem is a particular type of sequential Bayesian decision problem, in which current decisions 
(sensor configuration) may depend on previous observations. Sequential Bayesian decision theory is an ap¬ 
propriate approach for discrete-time, discrete-valued problems. Approaches to sequential Bayesian decision 
problems include probabilistic decision networks and dynamic programming for hidden Markov processes. 
Probabilistic decision networks have been developed under several different names, including Bayesian net¬ 
works, factor graphs, and influence diagrams. 

We have investigated the following target detection and localization problem: a target, located in one 
of M cells, is detected and/or localized by repeated use of a configurable sensor. Both single mode and 
dual mode sensors were investigated. The single mode sensor chooses a single cell to interrogate; the dual 
mode sensor chooses to interrogate either all cells simultaneously (Mode A) or a single cell (Mode B). We 
investigated two optimality criteria: 

1. Minimize the probability of error when the sensor is applied a fixed number of times. 

2. Minimize the number of sensor uses needed to achieve a given probability of error. 

We used probabilistic decision networks to derive and understand the structure of myopic and multi-step 
optimal decision rules for optimality Criterion 1. We also investigated both optimality criteria using dynamic 
programming; a quantization method was used to approximately compute the optimal stationary decision 
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rule for Criterion 2. For Criterion 1, the performance of the myopic optimal rule was compared to that of 
the multi-step optimal rule and to that of several heuristics using both simulation and exact computation. 
For Criterion 2, the performance of several heuristics was compared. Some of the results of this work for the 
dual mode sensor are presented in Section 3.2. 

In this section, we briefly review the tools of graphical models for decision processes and dynamic pro¬ 
gramming for hidden Markov processes. We then present results obtained for a dual mode sensor using these 
tools. 


3.1 Tools to Implement Sequential Bayesian Decision Theory 

We have used graphical models and dynamic programming (including the Partially Observed Markov De¬ 
cision Process [POMDP] formalism) to solve and understand discrete-valued sequential sensor scheduling 
problems. For sequential decision problems of the type resulting from attentive sensor problems, the compu¬ 
tational complexity of finding optimal rules typically grows exponentially, motivating the development and 
characterization of good heuristic configuration rules. 

Graphical Models The use of graphical models to represent probabilistic relationships in inference prob¬ 
lems has been developed in several different disciplines [5-8]. These models provide both a powerful method 
of representing complex probability distributions over many variables in terms of simpler relationships be¬ 
tween a few variables, and a method to mechanize the computation of posterior distributions in response 
to observed variables [5]. Graphical probability models can, with the addition of decision nodes, implement 
optimal Bayesian decision rules [5,9]. 

In the context of attentive detection, localization, and classification problems, the decision problem is 
specified in terms of the following model components: 

1. Probabilistic models of unknowns. Unknowns are modeled using prior probability distributions; for 
example, prior target state information (e.g. presence or absence, position, ID, etc.) would be modeled 
by a prior distribution. Complex target and environmental models can be formulated using graphical 
methods. 

2. Probabilistic models of sensor performance. The relationships between sensor settings, unknowns, and 
the resulting sensor observations are modeled by conditional probability distributions. These models 
may be derived from physical considerations or from statistical characterization of simulated or real 
sensors. 

3. Cost and/or utility functions. Utility functions quantify the costs and benefits of decisions. For 
example, utility functions measure the benefits and costs of correct and erroneous decisions about the 
unknowns, the cost of different sensor configurations, etc. 

Graphical methods provide tools for developing models and understanding their structure. Unfortunately, 
the solution techniques, while providing optimal solutions, do not typically discover computational reductions 
in the solutions that are available because of the structure of a specific problem. Additionally, the optimal 
solutions to problems involving multiple uses of a sensor typically grow exponentially in complexity as the 
number of sensor uses increases; graphical methods can make this problem clear, but may not provide insight 
how the structure of a given problem may be used to partially mitigate the exponential growth. Approximate 
computation in graphical models is an area of active research ( e.g . [10,11]). 

Dynamic Programming for Hidden Markov Processes The repeated configuration and use of a 
sensor can be modeled as a hidden Markov process. The optimal sequence of sensor configurations can 
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be determined (at least in principle) using dynamic programming [12]. The conditional distribution of 
the unknowns given the information state (the entire past history of sensor configurations and acquired 
observations) is a sufficient statistic for the computation of the optimal sequence of sensor configurations; 
consequently, the optimal sensor configuration rule is a function of this conditional distribution. The dynamic 
programming solution typically involves computation of a cost-to-go function, which is computed recursively 
backward in time. The optimal sensor configuration strategy is usually a closed loop strategy, in which the 
optimal sensor setting at a given time depends on the observations obtained previously. 

The methods used to compute the cost-to-go function and the associated optimal sensor configuration 
depend on the number of sensor uses. When the number of sensor uses is fixed before any observations 
are obtained, computing the optimal sequence of sensor allocations can be formulated as the solution to a 
Partially Observed Markov Decision Problem (POMDP) [13-15]. The solution of a POMDP is formulated 
in terms of value functions (which are essentially cost-to-go functions); under appropriate assumptions, the 
value function is piecewise linear and convex and can be computed as the solution of a linear program. 
Finding good approximate methods to compute value functions is a current area of research; see [16] for an 
overview of approximate methods. 

When the sensor is repeatedly used until a stopping criterion is met, computing the optimal sensor 
configuration can be posed as an infinite horizon dynamic programming problem; solving this problem is 
more difficult than solving a POMDP. Numerical evidence indicates that the cost-to-go function for this 
problem is discontinuous, ruling out POMDP solution methods. We have implemented an approximate 
solution algorithm, in which the probability simplex is discretized to points on a lattice, and probabilities 
are quantized to these points. This discretization scheme is similar to that used in [17] and can be used to 
study the solutions to small problems. 

3.2 Scheduling a Dual Mode Sensor 

To illustrate the application of Bayesian tools to attentive detection and localization, we present the problem 
of scheduling a dual mode sensor. This work was completed as part of the Attentive Sensing project. Portions 
of this work were presented in [1,2]. 

In the dual mode sensor problem, a target may be present in an area to be searched by the sensor. 
The sensor is capable of operating in two modes: either interrogating the whole search area (Mode A) or 
interrogating a single cell in the search area (Mode B). In either mode, the sensor returns a binary-valued 
observation indicating whether the target was detected in the interrogated area. Our objective is to correctly 
detect and (if present) locate the target from a sequence of observations collected by the sensor. 

The example presented here is an extension of the problem in [18-20]. In this previous problem, a general 
loss function was defined to reflect the desired outcomes of the sensor control problem. Also, the myopic 
optimal decision rule was derived and repeatedly applied to collect data until a stopping criterion was met. 
The performance of this approach was illustrated through several simulation examples, but no statistical 
characterization of performance over time was done. This work was also extended to include a Markov 
target motion model [21]. 

In this example, we use probability of error as our objective function. We also use a simpler model of 
sensor performance than that used in [19,20]; in our model, the sensor Mode B probabilities of detection and 
false alarm are the same for all cells. We derive the myopic optimal decision rule, and discover that it only 
depends on the probability that a target is present and on the probabilities of occupation of the two most 
probable cells. This is consistent with the results of [17,22], in which the myopic optimal rule was found 
for a single mode (Mode B) sensor; in [22], it was also shown that the myopic optimal rule is optimal over 
multiple sensor uses for the special case of a sensor with symmetric error performance. 
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Mathematical Model The target is either present and located in one of M possible cells or absent; the 
target state is a discrete random variable denoted I 6 A value of X = 0 indicates that the 

target is absent, while a value of X — x € {1,... , M} indicates that the target is in cell x. Our knowledge 
of the initial target state is represented by a prior probability distribution px (x). 

The sensor output after the nth sensor use is the binary valued random variable Y n . In Mode A, the 
sensor returns a value of Y n = 1 if the target is detected in any cell and a value of Y n = 0 otherwise. In Mode 
B, the sensor returns a value of Y n = 1 if the target is detected in the interrogated cell and a value of Y n = 0 
otherwise. The choice of sensor mode and, in Mode B, the cell to interrogate is denoted d n e {0,..., M }. A 
value of d n ~ 0 indicates Mode A, while a value of d n > 0 indicates Mode B interrogating cell d n . 

The sensor performance in each mode is known and characterized by a probability of correct detection and 
false alarm: pjy A and pp A in Mode A, and po B and pp B in Mode B. We define po A = 1~Pd a > PFa ~ 1 ~~Pf A x 
— l - p DB , and pp 7 = 1 - pf b - The conditional distribution of Y n given X and d n is 


PY\X,d(Vn\x> d n ) 


Pd a > 2/n = 1 and d n = 0 and x > 0 
pjJJ, y n = 0 and d n = 0 and x > 0 
pp A , y n = 1 and d n — 0 and x = 0 
pp ”, y n = 0 and d n = 0 and x = 0 
j y n = 1 and d n > 0 and x — d n 
Pq ”, t/ n = 0 and d n > 0 and x = d n 
PFb y Vn — 1 and > 0 and x^d n 
PD^y y n = 0 and d n > 0 and x ^ d n 


Each time the sensor is configured and an observed value y n is obtained, y n is used to update the 
distribution of X via Bayes theorem: 


P 2/n—^n—1)» ■ • > 2/l> ^l) 


PY\X t d(yn\ X > dn )p ( X \yn-l > <^n-l, ■ > ■ > 2/l ? ^l) 

py\xAy\ x '> d )p , d n -i , . . . , 2/1, C?1) 


The sensor is used repeatedly either a fixed N times or until the posterior probability of a value x conditioned 
on all observations exceeds a threshold close to one. At this point, the estimated target location is the value 
whose posterior probability is largest; the estimated target location is denoted x. 


Optimal Rule for N Sensor Uses The optimal rule determines the sequence of decisions 

that minimizes the expected probability of error. This rule can be easily derived using Bayesian decision 

networks [5] or dynamic programming [12]: 


di,... = arg max ^... max ^ max 


dx 


dpt 


' N 

]^[ PY\X,d ^nj 

,n=1 


p x {x) 


( 1 ) 


The computation of this sequence is straightforward and can be implemented by directly implementing (1). 
Unfortunately, the computational complexity of this approach makes its application infeasible for all but 
small problems. 

The myopic optimal rule (to minimize the probability of error after one observation) is a straight-forward 
extension of the myopic optimal decision rule for a single-mode sensor [17,22]. The structure of the problem 
allows significant simplification compared to a naive implementation of (1). The myopic optimal rule depends 
only on the probability that no target is present and the probabilities of the most probable and second most 
probable cells. The myopic decision rule is the following; for notational convenience, we drop the time 
subscript on d and the explicit conditioning of the distribution of X on past observations. 
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Let m and m be the cell with largest probability and the cell with second largest probability: 

fn — arg max px i x ) 

x>0 

rh — argmaxpx(z) 

*>j)_ 

x^m 

Compute the following values: 

Lq = max [pf7 px (0) , Pd A Px (m)] + max \pp A px (0) , Pd a Px (m)] 

Lrn = max[pF^px(0),po7px(m),pF^px(^)] + niax[pFB Px(fy,PD B Px(™),Pf b Px{m)\ 

Lrn = max [pfJ p x (0) , pf, b Px (m) , p5^ Px (™)] + max \p Fs p x (0) , pf b Px (m) >Pd b Px (™)] 
If Lrh is largest, set d 0 = ro. Otherwise, if L 0 is largest, set d 0 — 0. Otherwise, set d 0 = m. 


Optimal Rule to Minimize the Average Number of Sensor Uses The optimal rule to minimize 
the number of sensor uses is an optimal stationary policy of an infinite horizon partially observed Markov 
decision process. Numerical simulations indicate that the optimal cost-to-go function is discontinuous (and 
hence not convex). Thus, the POMDP solution techniques based on piecewise linear functions cannot be 
used. We have found approximate optimal rules by quantizing the probability simplex into a lattice of points, 
and computing the optimal stationary policies and cost-to-go for the quantized simplex. The approximate 
optimal rules are functions of the probability distribution of X; based on these results, we believe that 
computationally tractable representations of these rules will be difficult, if not impossible, to find. This 
motivates the search for good suboptimal heuristics. Figure 1 shows a plot of the optimal decision function 
when N — 2 for the following sensor parameters: po A = 0-8, Pf a = 0.15, po B — 0.95, pp B = 0.06. The plot 
is a projection of the simplex onto the plane of the paper; the distribution [px(0) = l,px(l) = 0,px(2) = 0] 
is in the lower left corner, the distribution [px(0) — 0,px(l) = 0,px(2) = 1] is in the lower right corner, 
and the distribution [px(0) = 0,px(l) = l»px( 2) — 0] is in the top middle. Note that there are not easily 
defined decision boundaries, precluding a simple representation of the optimal policy. 

Heuristics These heuristics are motivated by the myopic optimal solution (similar heuristics have been 
found to perform well for the simpler single mode problem in [1]). 

1. Choose d n as the most probable value of X. 

2. Choose d n as the the second most probable value of X. 

3. Choose the myopic optimal control. 

4. If the probability of target present is below a threshold close to one, choose d n = 0; otherwise, choose 
d n as the most probable value of X . This heuristic was used only when repeating observations until 
the probability of correct decision exceeds a threshold. 
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Optimal Decision 
Mode A 

Mode B, most prob. 
Mode B, least prob. 
Terminate 


Figure 1: Optimal decision function: pp A = 0.8, pp A = 0.15, po B = 0.95, pf b = 0.06. 
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Figure 2: Comparison of the probabilities of error for the multi-step optimal and myopic optimal decision 
rules: po A = 0.8, pp A = 0.15, p Ds = 0.95, pp B varied from 0.01 to 0.30. The number of cells was M = 6; 
the probability of error was evaluated for N = 5 and N = 7 sensor uses. 


Computation of Performance The probability of error for N sensor uses given a particular control law 
is computed directly by considering a tree; each path from the root of the tree to a terminal node represents a 
possible sequence of observations. The probability of error can be computed by doing a depth-first traversal 
of the tree. The average number of sensor uses needed to guarantee a given probability of error is also 
computed by traversing a tree of possible observation sequences. In this case, the branches of the tree may 
have differing lengths (some branches may have infinite lengths, corresponding to observation sequences for 
which the decision rule does not terminate). In order to complete the computations in a reasonable amount 
of time, computations are truncated when the probability of the observation sequence associated with a 
branch in the tree drops below a specified threshold. Thus, the computed average number of sensor uses is 
lower than the actual expected value; we estimate that relative magnitude of this error is no more that a 
few percent. 

Evaluation of Performance We have evaluated optimal and heuristic decision rules in terms of their 
probability of error and average number of observations needed. In particular, we have made the following 
evaluations: 

1. Comparison of the probability of error of the multi-step optimal and the myopic optimal algorithms 
for a fixed number of sensor uses. 

2. Comparison of the myopic optimal, most probable, and second most probable heuristics for a fixed 
number of sensor uses. 

3. Comparison of all four heuristics to minimize the number of sensor uses. 
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—MostProb 2nd Most Prob —A—Myopic Opt 


Figure 3: Comparison of the probabilities of error for the myopic optimal, most probable, and second most 
probable decision rules: p& A = 0.8, pf a = 0.15, pd b ~ 0.95, pp B varied from 0.01 to 0.30. The number of 
cells was M — 10, and the number of sensor uses was N = 15. 

4. Comparison of the most probable heuristic with the optimal rule to minimize the number of sensor 
uses. 

The relative performance of the multi-step optimal and the myopic optimal algorithms for a fixed number 
N of sensor uses was computed. These computations were performed with M — 6 cells and values of AT of 5 
and 7. The probabilities of detection and false alarm for the two modes were set to po A = 0.8, pp A = 0.15, 
PDb _ o.9, and pf b was varied from 0.01 to 0.30. Figure 2 shows the probability of error as a function of 
Pf b ; note that the performance improvement of the multi-step optimal over the myopic optimal is not large. 

The relative performance of the myopic optimal, most probable, and second most probable heuristics 
were also evaluated for a fixed number of sensor uses. This evaluation was performed with M = 10 cells and 
N= 15 sensor uses. The probabilities of detection and false alarm for the two modes were set to pu A = 0.8, 
pp A = 0.15, p Db = 0.9, and pp B was varied from 0.01 to 0.30. Figure 3 shows the probability of error as a 
function of pf b . From the figure, it is clear that the myopic optimal decision rule has the best performance. 
For larger values of p Fei the performance of the most probable decision rule is the same as the myopic 
optimal because the myopic optimal almost always chooses the most probable value of X . 

The expected number of sensor uses necessary to achieve a probability of error less than 0.05 was computed 
for the four heuristics. This computation was made with M — 10 cells, and the probabilities of detection 
and false alarm for the two modes were set to po A = 0.8, pp A = 0.15, pp B = 0.9, with pp B varied from 0.01 
to 0.30. Figure 4 shows the average number of sensor uses as a function of pf b ♦ Choosing the most probable 
value of X gave the best performance. The two-stage heuristic also gave good performance. 

In order to characterize the sub-optimality of the heuristics in minimizing the expected number of ob¬ 
servations necessary to achieve a given probability of false alarm, the cost-to-go functions for the optimal 
rule and for the most probable rule were computed using the probability discretization approach. Figure 5 
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Figure 4: Comparison of the expected number of sensor uses for the myopic optimal, most probable, second 
most probable, and two stage decision rules: Pd a = 0.8, pp A = 0.15, pu n = 0.95, pp B varied from 0.01 to 
0.30. The number of cells was M = 10. 


shows several histograms of the relative increase in the expected number of sensor uses for the most probable 
rule relative to the optimal rule over all points in the lattice. These results are for M — 10 cells. From 
these histograms, we see that the most probable heuristic is typically 20-30 percent worse than the optimal. 
Note that these values are computed using the quantized probability simplex and are approximations to the 
performance of the actual system. 

Overall, these results show that heuristics with low computational requirements and good performance 
are often available. In particular, the myopic optimal solution appears to give good performance when 
minimizing the probability of error for a fixed number of observations; the myopic optimal heuristic has been 
used frequently [15,17,19-21]. Also, choosing the most probable value of X gives good performance when 
minimizing the number of sensor uses. 


4 Attentive Estimation in Dynamical Systems 

Discrete-time dynamical systems represent the dynamics of targets of interest. Attentive estimation of the 
state of these system models requires that sensors be configured before collecting observations. Thus, we 
have considered dynamic systems with configurable output maps; the sensor output maps may include non¬ 
linear relationships between observations and the system state. Our goal was to find control laws for sensor 
configurations to optimize state estimator performance. 

We have used Bayesian filters implemented by particle filtering (sequential importance sampling methods) 
as state estimators. In a Bayesian filter, the estimator directly computes the posterior density of the system 
state given the observation sequence. For a given a cost function ( e.g . squared error), the optimal state 
estimate can be computed from this density. Bayesian filters have many properties that are important for 
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Figure 5: Histograms of the relative increase in the expected number of sensor uses for the most probable 
decision rule relative to the optimal decision rule. The number of cells was M — 10: (a) PDa ~ ^.8, pp A = 0.2, 
PDb = 0.95, PFb = 0.00, (b) PDa = 0.8, pp A = 0.2, PDb = 0.74, PFb = 0.25, (c) PDa = 0.9, pp A = 0.1, 

PD B = °- 95 > PFb = °- 06 ’ 
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the proposed work [23]: estimators for dynamic systems with non-linear state dynamics and observation 
maps can be formulated; the system state and the observation can include both continuous and discrete 
components; constraints on possible state values can be incorporated directly into the estimate; and multi¬ 
modal prior and posterior densities can be represented, so that observation maps that are many-to-one (i.e. 
that map many state values to a single observation) can be addressed in a straight-forward way. The primary 
difficulty in implementing a Bayesian filter is that closed form expressions for the posterior density typically 
do not exist. Thus, we use particle filtering (a form of Monte Carlo sampling) to implement these filters. 

In this section, we briefly review foveal sensors and particle filters. We then present results obtained for 
a foveal sensor tracker. 

4.1 Foveal Sensors 

A foveal sensor has a high acuity region surrounded by a low acuity region. Foveal sensors are inspired by 
the characteristics of biological vision systems. Much of the work done in tracking targets with foveal sensors 
has been done in the context of computer vision (e.g. [24,25]), and most has been primarily concerned with 
the development of hardware systems that can track simple objects visually. 

Theoretical work on tracking a target in one dimension with a foveal sensor is described in [26,27]. The 
emphasis of this work was the development of different approximation techniques to address the non-linear 
foveal sensor and, in the process, develop bounds on expected squared tracker error that could be computed 
using a Kalman filter. Most of the approximations were implemented using an observation data pre-processor 
followed by a Kalman filter. This work showed that the foveal sensor provided improved tracker performance 
(in the form of reduced squared error) over non-foveal sensors. 


4.2 Particle Filtering 

Particle filtering is a generic name for Monte Carlo sequential importance sampling methods to estimate the 
state of a dynamic system from noisy observations. Over the last decade, sequential importance sampling 
methods have been developed in many disciplines, including target tracking, image and video processing, 
signal processing, statistical mechanics, molecular biology, robot navigation and control, and artificial in¬ 
telligence (reasoning under uncertainty). A comprehensive survey of the theory and application of particle 
filters is provided by [28], and an excellent tutorial introduction to state estimation using particle filters is 
provided in [29]. Particle filters and related Monte Carlo techniques are solving many target tracking and 
signal processing problems [30]. 

Let Xk denote the state of a discrete-time system at time k> and let z k denote the observation of the system 
at time k. The discrete-time system model consists of a dynamic equation and an observation equation: 

Xk +1 = fk {Xky^k) 

Z k — h k (xk,Vk) 

In this model, /*(•) and h k (-) may be non-linear functions of their arguments, and the noise values w k 
and v k may be non-Gaussian; for most target tracking problems, w k and v k axe assumed to be white and 
independent of each other. 

In a particle filter, the predicted and posterior densities p(xk\zu • • • and p{x k \z\, ... ,z k ) are 

approximated by a collection of pairs of samples and weights. The collection is denoted ,w k 
where x^ denotes a sampled state value and denotes its importance weight. Each pair in this collection 
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is called a particle. The expected value of a function of the state is approximated by the following sum: 

A/ 

»=i 

An iteration of a particle filter consists of computing samples of the posterior density p(x k \zi,.. .,z k ) from 
samples of p(ar fc _i|«i,... ,z k -\). This computation is typically accomplished by sampling from a proposal 
distribution, computing importance weights for the new sample, and then optionally resampling according 
to the importance weights. Typically, the proposal distribution is one from which samples can be drawn 
efficiently; p is often used as a proposal distribution. The importance weights depend on the 

actual value observed for z k \ when p is used as the proposal distribution, the importance weights 

are proportional to p . Under reasonable conditions, it has been shown that this process converges 

asymptotically to the exact posterior distribution p (x k \zi ,... ,z k ) as the number of particles goes to infinity. 

Several techniques have been developed to reduce the number of particles (and thus the computational 
load) needed to implement a particle filter with a desired error performance. One technique is Rao- 
Blackwellization, in which components of the state or observation that have closed form expressions for 
marginal densities are marginalized out. When the system state dynamics are linear with additive Gaussian 
noise, and the (non-linear) observation depends only on a component of the state, Rao-Blackwellization 
significantly reduces the number of particles needed in the computations. Also, the choice of the proposal 
distribution strongly affects the performance of the filter; one must often make a difficult trade off between 
the computational complexity of choosing samples from the proposal distribution and the number of particles 
needed to obtain a desired accuracy. 


4.2.1 Example-Target Tracking Using a Foveal Sensor 

We illustrate the potential benefits of target tracking with an attentive sensor by considering tracking of 
a target capable of 1-D motion using a foveal sensor. This is work completed under the Attentive Sensing 
project. Portions of this work were presented in [3]. 


Target Dynamics Model for 1-D Motion The target dynamics are modeled as a linear discrete-time 
system driven by white Gaussian noise. The system state at time t k consists of two components and is 


denoted 


Xfc - 


xi(k) 

x 2 {k) 


The target dynamics equation is 

x/c+i = Axfc + gw k 

where A is a 2 x 2 matrix, g - [ 0 1 ]', and w k is a scalar white noise process with variance Q. For an 

appropriate choice of A, xi(k) models the target position on a line and x 2 (k) models the target velocity. 


Foveal Sensor The foveal sensor is described by the following equation: 

z k = tan” 1 ( C k [xi(fc) - d k )) + v k 

where z k is the observation at time A;, v k is white Gaussian noise with covariance Jf?, d k is the location of 
the center of the foveal region, and C k is the gain in the foveal region. Figure 6 illustrates the relationship 
between output and state for the foveal sensor. 
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Figure 6: Output function of the foveal sensor; the foveal region is centered at d , and the acuity (gain) in 
the foveal region is approximately C k , the slope of the output function at x x (k) — d k . 


Configuring the Sensor Before obtaining an observation, the sensor is configured by choosing values for 
both d k and C k . We set d k to x x {k), the predicted estimate of x x (k) given the observations z x through z k - 
(This value for d k was also used in [26,27].) 

Conceptually, the value of C k is chosen so that a given percentage of the predicted particles will fall 
within the sensor’s foveal region. In addition, the sequence of gains is smoothed using a simple exponentially 
weighted averaging filter. Thus, C k is computed as 

C k = (1 — oc)C k 4- otC k - 1 , 

where C k is the instantaneous gain whose computation is described below, and a is the exponential weighting. 
By experimentation, we have determined that a = 0.8 performs well. 

The instantaneous gain C k is chosen after the value of d k has been computed. Let w k be the value for 
which a given percentage of the first component of the predicted particles falls into the interval [d k — w k , d k + 
w k ]. Then the instantaneous gain C k is chosen so that the foveal region is [d k — w k , d k -f~ w k ]: 

k 2 w k 

For the results shown in Figure 8, w k is chosen so that 80% of the predicted particles fall within the foveal 
region. 


Performance Results for the 1-D Foveal Sensor We compared the particle filter implementation of 
the foveal sensor tracker with the best Kalman filter based tracker (of the several considered) in [27]. For 
this comparison, we used a system dynamic matrix 


0.75 0.2 

—0.2 0.75 


and a foveal sensor with both fixed and adaptive acuities. The gain of the fixed sensor was set to be consistent 
with the foveal sensor in [27]. 

The performance of the tracking algorithms was evaluated using Monte Carlo simulation; algorithms 
were compared on the basis of the average squared error in the tracker estimate of x x (k). Figure 7 shows 
curves of constant average estimation error as a function of the observation and driving noise variances. The 
particle filter fixed gain tracker performs as well as the best Kalman filter fixed gain tracker over most of the 
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Figure 7: Curves of constant estimation error as a function of observation and process noise variances for 
the best Kalman Filter based tracker (KF, Fixed Gain), the adaptive acuity particle filter tracker (PF, Var. 
Gain), and the fixed acuity particle filter tracker (PF, Fixed Gain). 

range of observation and process noise variances. The particle filter adaptive gain tracker performs better 
than the fixed gain trackers over most of the range of noise variances. The particle filter does not perform as 
well as the Kalman Filter when the observation noise variance is very small. This is because the observation 
density is sharply peaked for small variances, and few (if any) particles have weights significantly larger than 
zero. Several approaches have been developed to address this problem [28,29]; we are currently investigating 
whether they can be applied to the foveal sensor. 

A more detailed comparison of the fixed acuity sensor and the variable acuity sensor was also conducted. 
The system dynamic matrix was 

A = 

These dynamics model one-dimensional motion with an interval of two seconds between observations. The 
process and observation noises were Gaussian white noise with variances Q — 0.05 and R = 0.02. The initial 
state was Gaussian with mean zero and variance one for both state components. 

The average squared error in the estimate of xi(k) is shown in Figure 8 as a function of k for the adaptive 
acuity sensor and for three fixed acuity sensors. The fixed acuity sensors have gains of 0.25, 1.00, and 4.00. 
The squared error is averaged over 2,500 simulation runs. The adaptive acuity sensor performed better than 
any of the fixed acuity sensors. The tracker using the low-gain fixed-acuity sensor converges quickly but to 
a large average error. The tracker using the high-gain fixed acuity sensor converges slowly since the tracker 
searches for the target using a very narrow foveal region. 

Extension to Three Dimensions We have extended the one-dimensional tracker to track targets in 
three dimensions. The three dimensional tracker uses three foveal sensors; each sensor measures azimuth 
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Figure 8: Average squared error in the estimate of x x (fc) as a function of k for the adaptive gain and fixed 
gain sensors. 


and elevation angles from the sensor to the target. Each sensor is aimed at the predicted position of the 
target, and the acuity of each sensor is adjusted individually using the algorithm described above. 

We have investigated both global and local control schemes. In the global control scheme, the observations 
from all sensors are used by a global controller to estimate the target state; this state estimate is then used 
to configure all of the sensors. In the local control scheme, each sensor computes an estimate of the target 
state using only its observations; each sensor is configured using its local state estimate. Observations from 
each sensor are passed to a global estimator which estimates the target position. As expected, the global 
control scheme provides better estimates of the target state than the local control scheme. This improved 
performance comes at the cost of a significant increase in the information that must be communicated 
between the control node and the individual sensors. 
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